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Abstract 

In this paper a general definition of quantum conditional entropy 
for infinite-dimensional systems is given based on recent work of Holevo 
and Shirokov [3] devoted to quantum mutual and coherent informa- 
tions in the infinite-dimensional case. The properties of the condi- 
tional entropy such as monotonicity, concavity and subadditivity are 
also generalized to the infinite-dimensional case. 



1 The definition 

In this paper a general definition of quantum conditional entropy for infinite- 
dimensional systems is given based on recent work of Holevo and Shirokov 
^ devoted to quantum mutual and coherent informations in the infinite- 
dimensional case. The necessity of such a generalization is clear in particular 
from the study of Bosonic Gaussian channels and was stressed also in [7]. 
We refer to [3j for some notations and preliminaries. Let A, . . . be quantum 
systems described by the corresponding Hilbert spaces T-La, ■ ■ ■ , and let $ be 
a channel from A to B with the Stinespring isometry V : T-La — > 'Hb^'He- 
Let Par be a purification of a state pa with the reference system R and let 
Pbre be the pure state obtained by action of the operator V®Ir. The mutual 
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information of the quantum channel $ at the state pa is defined similarly to 
finite- dimensional case (cf. [T], [2]) as 

I{pA, = H{pbr\\pb ® Pb), 

and coherent information at the state pa with finite entropy H{pa) is defined 
as follows P] 

Upa,<^)=I{Pa,<^)-H{pa). 
It is then shown that the above-defined quantity satisfies the inequalities 

-H{pa)<Ic{pa,<^)<H{pa) 
and the identity ^ 

/e(pA,$)+/c(pA,$)=0, (1) 

where $ is the complementary channel. 

Let A, C be two (in general, infinite-dimensional) systems and pac a state 
such that H{pc) < oo. We define the conditional entropy as 

H{C\A) = H{pc) - H{pAc\\PA ® Pc), (2) 

where -f^(-||-) is the relative entropy which takes its values in [0, +oo], so that 
H{C\A) is well defined as a quantity with values in [— oo, -|-oo). If in addition 
H{pa) < oo , one recovers the standard formula H{C\A) = H{AC) — H{A). 

Now let B be infinite-dimensional system so that arbitrary state psc can 
be purified to a pure state pabc- Consider the channel $ = Tr^i from AB to 
B so that $ = Tr^, then 

h{pAB,TrB) = I{pAB,TrB)-H{pAB) = H{pAc\\pA®Pc)-H{pc) = -H{C\A). 

(3) 

Similarly 

Ic{pAB,TrA) = I{pAB,TrA)~H{pAB) = H{pBc\\PB®Pc)-H{pc) = -H{C\B). 

(4) 

From the results of [3] concerning the coherent information, we then obtain 
that under the condition H{pc) < oo both H{C\A), H{C\B) are well defined 
and satisfy 

\H{C\A)\ < Hipc), \HiC\B)\ < H{pc), (5) 
H{C\A) + H{C\B) = Q, (6) 
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2 Properties of conditional entropy 

Proposition 1. Let pab be such a state that H{pa) < oo. The function 
H{A\B) has the following properties: 

1. monotonicity: the inequality 

H{A\BC) < H{A\B). (7) 

holds for any systems A, B, C. 

2. concavity in pab '■ if Pab = (^Pab + (1 ~ '^)Pab^ ^ [0' 1]; ^^^'^ 

H{A\B) > aH{A^\B') + (1 - a)H{A^\B^). (8) 



3. subadditivity: the inequality 

H{AB\CD)<H{A\C) + H{B\D). (9) 

holds for any systems A, B, C, D such that H{pa) < oo, H{pb) < oo. 

Proof. 1. To prove monotonicity we rewrite the inequality ([7]) using the 
definition ([2]), i.e. 

H{pa) - H{pabc\\pbc ® Pa) < H{pa) - H{pab\\pb ® Pa)- 
which is equivalent to 

H{pab\\pb ® Pa) < H{pabc\\pbc ® Pa), 

and the last inequality holds by monotonicity of the relative entropy with 
respect to taking the partial trace. 

2. Let P^, be arbitrary increasing sequences of finite rank projectors 
in the spaces 'Ha,'Hb, strongly converging to the operators Ia,Ib respec- 
tively. Consider the sequence of states 

Pab = KliPn ® PkPABP^ ® P^), Xnk = Tr(P„^ ® Pf )p^B, 

with the partial states p^, p^. 
Let us show first that 

lim H{Ank\Bnk) = H{A\B). (10) 

n,fc— >oo 
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By the definition © H{A^k\Bnk) = H{pf)-H{p%\\pf®pf). By using 
lower semi-continuity of the von Neumann entropy we obtain 

hm miH{Xnkpt)>H{pA). 

n,k—^oo 

On the other hand, P, lemma 4] implies 

H{\nkpf) = H{P^{i:iBl®PkPABl®Pk)Pn) < H {Tl B I ® PAB I ® Pk) ■ 

Further, by the dominated convergence theorem for entropy [4j we have 
hm H{TtbI ® Pk'^PABl 8) Pk) = HipA), 

n,fc— >oo 

since Ttb{I ® P^pab^ ® Pk) — Pa and H{pa) < oo. Thus by the theorem 
about the limit of the intermediate sequence we obtain 

lim H{X^kpf) = H{pA), hence, lim H{pf) = H{pA). 

Then we prove that lim H{pi'^Q\\p'^ ® p^) = H{pab\\pa® Pb)- Consider 
the following values 

H^k = H{p%\\pt ® Pf) = H{pf) + H{pf) - H{pfB), 

H^k = H [ptBWrk'PuPBP^ ® Pu'PuPaP^) = -H{ptB)~ 
-Tr [pf] log [p^'P^PaP^) - Tr {pf) log [vu'P^PbP^) , 
where /i„ = TrP^p^, Vk = Tr P^^ps. 
By using again [5], lemma 4] we have 

hm = hm H {P:^ ^ P.^pabP:^ ® Pk'^WPkPBPk'' ® P^^PaP:^) 

= H{pab\\pb ® Pa)- 

We will prove that lim„_j!c^oo -^^n/c = H{pab\\pa ® Pb) by considering the 
difference — H^k- After some calculation we obtain that the difference 
tends to zero: 

hm (Hr.k-Hr.k)= lim {H {pf\\p~^ P^ paP^) + H [p^j^Wr^^^ P^ pbP^)) 



The last double limit is equal to zero since it follows from [51 lemma 4] that 
< H [XnkPtWP^PAP^) = H {P^Tib{Ia ® P^PabIa ® P^)P^\\P^ PaP^) < 

< H {Ttb{Ia ® PkPABiA ® Pk)\\pA) , 

and [31 lemma 7] implies 

lim H {TiBilA ® PkPABiA ® Pk)\\PA) = H{pa\\pa) = 0. 

n,K— >oo 

Thus, the theorem about the limit of the intermediate sequence implies 
hm H{X^,pf\\P;^pAP^)= lim H{pf\\p-'P^pAP^)=0. 

Similarly we obtain that the second summand of the difference Hnk — Hnk 
also tends to zero: 

lim H{pf\\v^'P,^pnP,^)=0. 

Finally, we have 

lim H{p%\\pf(dpf ) = H{pab\\pb(^Pa), hence lim H{Ank\Bnk) = H{A\B). 

n,k—^oo n.k—^oo 

To prove the concavity of the function H(A — B) let us consider 
PAB = ap\B + (1 - a e [0, !]• 

Also consider again 

PaB = KlPn ® PkPABPrf ® Pk"" = 
a{P^ P,^P%P;^ ^ ) + (1 - «)(P„^ ^ Pk^p'ABPn ^ P^) _ OjkPAB + OlkPAB 

«Tr(P,^ ® P^p\^) + (1 - a)Tr(P„^ ® P^ p\^) dl, + 61, 



Oik = «TrP- P-p\„ pTb = -""^ ^ PfBPn ^ Pk ^ 

^nk 

elk = (1 - «)TrP„- ® P-pi„ = - ^)Pn ® PJ p\bP^ ® P^ ^ 

^nk 
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Due to concavity of the condition information on the finite rank states 
we can write that 

H{Ank\Bnk) > fll ? /92 ^i^nkl^nk) + nl _? /i2 ^i^nkl^nk) 
^nk "T ^nk ^nk ^nk 

Taking the hmit and using f fTOj) for both parts of inequahty we obtain the 
assertion of (|H])- Thus, concavity is proved. 

3. A direct verification shows that in the finite-dimensional case 

H{AB\CD) = H{A\CD) + H{B\CD) - {H{A\CD) - H{A\BCD)), (11) 

which imphes 

H{AB\CD) < H{A\CD) + H{B\CD), (12) 

since the value in brackets in fill I) is nonnegative. We will prove the inequal- 
ity (|T2|) in infinite-dimensional case, the subadditivity property ([9]) can be 
derived from f|T2|) by using monotonicity of the conditional entropy. 

Let pabcd = P E T-La ® Hb ® T^c ® be a state with H{pa) < 
oo, H{pb) < oo. Consider an arbitrary increasing sequence of finite rank 
projectors {Pf^} which strongly converges to the operator Icd- Also con- 
sider the sequence of states 

p' = t^\Ia ®Ib® PF'')p{Ia ®Ib® PD, ri = Ti{Ia ®Ib® PDp- 

The relation (ITT!) (which implies (fT2|) ) holds for p' since all the summands in 
(fTTj) are finite. 

We will show that H{A^\CD^) H{A\CD). Actually, using the definition 
([2]) we have 

H{A^\CD^) = H{p\) - H{p\cd\\Pcd ® Pa)- 
It follows from the dominated convergence theorem for entropy [1] that 
lim H{p\) = hm H {r-'TiBCD{lA ®Ib® PF'')p) = H{pa). 

i— s>oo )-oo 

Further, consider the values 

Hi = H{p\cd\\Pcd ® Pa) = ~H{p\cd) + H{p\) + H{p'co). 

and 

Hi = H{p\c^yc^®pA) = H [r-^A ® PF^'IpacdVa ® P^Wpa ® r^^ P^'''[pcd\PD = 
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[pacd]) {-\og Pa). 



lim Hi = H{pacd\\pa ® Pcd)- 



On the other hand, after the calculation and using [3l lemma 7] we obtain 



This implies that 

lim H{p^^cd\\Pa^Pcd) = H{pacd\\pa®Pcd), hence, lim H{A^\CD^) = H{A\CD). 

In the similar way we obtain H{B^\CD^) —> H{B\CD) and 
H{AB^\CD^) H{AB\CD). Thus the statement is proved in infinite- 
dimensional case, hence, the subadditivity property holds. □ 

The following observation is due to M. E. Shirokov. 

Proposition 2. Let A be a subset of &{T-Lac') such that the von Neumann 
entropy is continuous on the set = Tr^^ C SiTic)- Then the function 
Pac ^ continuous on the set A. 

Proof Let {p„} C ^ be a sequence converging to a state po ^ By the 
well known results of purification theory there exists a corresponding se- 
quence of purifications C &{T-Labc) converging to a purification po G 
^iT^ABc) of the state po- The sequence {Trcp„} converges to TrcPo and 
lim„^+oo ^(TrcPn) = ^(TrcPo) by the condition (since HiTicPn) = H{TiABPn))- 
Proposition 4 in [3] implies 



□ 

The author is grateful to A.S. Holevo and M.E. Shirokov for suggesting 
the problem and for discussions and the help in preparing the manuscript. 



\im{Hi-Hi) 



lim H {rr'TicDlA ® PF''[Pacd]\\Pa) = 0. 

I— >oo 



lim /c(Trcp„, Trs) = Jc (TrcPo, Tr^j). 
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